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ABSTRACT 



A method of automatically adjusting the tone scale adjust- 
ment for digital radiographic images. The method includes 
the steps of providing an input digital radiographic image; 
estimating the image noise as a function of code value of the 
image; determining the range of code values in the input 
image; determining which way the input image should be 
processed; determining a bounding box which contains the 
region of interest of the input image; computing the image 
activity histogram of the input image; determining four 
points from the image activity histogram; constructing the 
tone-scale curve for the input image; and mapping the input 
image through the tone-scale curve to produce an output 
image with good tone scale. 

22 Claims, 14 Drawing Sheets 
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AUTOMATIC TONE SCALE ADJUSTMENT evaluation and (2) to construct a tone-scale transfer curve so 

USING IMAGE ACTIVITY MEASURES that the important sub-range of the code values identified in 

step (1) can be rendered with proper contrast and brightness 

FIELD OF THE INVENTION (density) on the output media. For example, the digital code 

. .. . ^ ^ . * 5 values of an input chest x-ray image may span from 500 to 

lbs M disdoiei an «« tt»e icalc adiost 3QQQ ^ ^ * f QMl x ^pollre), b Vt£ e code value 

mentmethodformgitalm^ range of the lung area, being the most important region of 

radiographic images in particular. The tone scale adjustment ^ only span from 1800 to 2 6oa If we attempt 

is to render an input image on an output media for visual to ^ ^ entire range of the ^ code value (from 500 to 

inspection or exannnatioa ^ 3m) ^ ^ availahie ^ tensity range with equal contrast 

BACKGROUND OF THE INVENTION f OT all input code values, we will produce a chest image with 

an unacceptably low contrast It is therefore very important 

Computed radiography uses storage phosphors to record to have an automatic algorithm to detect and select the 

the radiation image from x-ray transmission. The stored relevant sub-range of the input code values (1800 to 2600) 

image is then read out by light-stimulated emission, which to be displayed on the output media with proper visual 

is amplified by a photomultiplier, transformed into desired contrast and brightness. The process of selecting the relevant 

signal units (such as log-exposure) and quantified into sub-range of input code values and constructing the proper 

digital numbers called code values. The code values can be, mapping function from the input code value to the output 

recorded with a certain number of bits. For a 12-bit digital display media is called the tone scale adjustment, 

image, the code value ranges from 0 to 4095. These code 2Q The first problem, selecting the important code value 

values are then manipulated by computers and then mapped sub-range, has been approached in the past by using the 

through a tone-scale curve to an output display, such as a histogram of the input code values either in exposure space 

cathode-ray-tube monitor or a photographic film. 0 r in log-exposure space. (We will refer this histogram as the 

Computed radiography using storage phosphors offers a code-value histogram to differentiate it from the image 

very wide exposure latitude (10,000:1) compared with that ^ activity histogram used in this invention.) U.S. Pat No. 

of the conventional screen/film systems, (40:1). This means 4,914,295 teaches a method for excluding the irrelevant 

that exposure error is much less serious for computed background region in an image by detecting a peak in the 

radiography at the time of image sensing and recording (but code-value histogram near the maximum input code value, 

not at the time of image display, as will be explained later). This method requires a prior filter to remove the image 

It also means that the tone scale mapping in computed 30 region covered by the collimator blades. It also needs a 

radiography can be specifically tailored to provide an opti- different preconstructed tone-scale curve in accordance with 

mal rendition of every individual image. However, most the examination type entered by the operator. U.S. Pat No. 

output media, such as photographic film and cathode ray 5,046\118 discloses a method of analyzing the code-value 

tube (CRT), do not have wide enough dynamic ranges to histogram by an entropy measure. U.S. Pat. No. 5,268.967 

display the 10,000:1 latitude of information with proper 35 teaches a method of using edge density for segmenting 

visual contrast It is, therefore, necessary to carefully alio- image into foreground, background, and body part regions, 

cate the available output dynamic range to display the It also relies on the prior knowledge of the body part being 

clinically important part of the input code values. For some examined. 

appUcations, the interested range of the input image may All the prior art methods attempted to perform the tone 

exceed that provided by the output media and the contrast of ^ sca i c adjustment of an input image based on the analysis of 

parts of the input image will have to be compromised. U.S. ^ code-value histogram. A code-value histogram contains 

Pat No. 4302,672 teaches a method of constructing such a on i y the information about the number of pixels at various 

compromised tone-scale curve for chest x-ray images. exposure or log-exposure values. It does not tell us which 

However, that method uses the valleys and peaks of the co fe va i ue sub-range, contains the important body part 

code-value histogram to identify the critical points between 4g image. Analysis of this type of histogram is thus always 

the spine, the heart, and the lung. The results are not very performed under various ad hoc assumptions about the 

reliable because these valleys and peaks are not always image contents. When the assumptions are not valid for an 

clearly detectable. Furthennore, the method cannot be gen- m put image, these methods tend to produce a very unac- 

eralized to examinations other than chest images. ceptable output image. 

There are mainly five classes of "objects" in radiographic so The second problem, constructing the proper tone-scale 

images: (1) the foreground (collimator blades used to protect curve, has been approached in the past in two different ways, 

parts of the body from unnecessary x-ray exposure) usually U.S. Pat No. 4,641.267 teaches a method of providing a set 

corresponding to very low to low exposure areas; (2) the of reference tone-scale curves (about 10 of them) to choose 

man-made objects (such as pacemakers, tubes, and from and for each chosen reference curve a slight adjustment 

electrodes); (3) the soft tissues (such as muscles, blood 55 of exposure and contrast is made based on the code-value 

vessels, and intestines) usually correspond to low (e.g., histogram. The tone-scale curve used depends only slightly 

mediastinum) to high (e.g., lung) exposures depending on on an individual image, but rather mostly on its examination 

the thickness; (4) the bones corresponding to the very low to type. This has the advantage of providing a consistent 

low exposures (often overlaps with the foreground); and (5) appearance of the final displayed images for any given 

the background corresponding to the very high exposure ^ examination type. U.S. Pat No. 5,164,993 teaches another 

areas. These five classes of objects are very difficult to method for constructing a tone-scale transfer curve based on 
separate using the code value alone because, there are the code-value histogram, such mat the output density is 
considerable overlaps (such as the bone and the collimator substantially a linear function of the input exposure. The 

blades). resulting tone-scale curve is highly image dependent This 

The two basic problems in the tone scale adjustment for 65 has the potential of providing a customized, optimal tone- 
computed radiography are: ( 1) to determine which sub-range scale curve for each individual image. However, both meth- 
of the input code values is most important for clinical odsrely on the code-value histogram and do not consider the 
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characteristics of human visual system for tone-scale rigid templates for image composition. The pertinent infor- 

construction. Both methods also require separate prepro- mation is automatically extracted from the image signal 

cessing procedures for eliminating the image regions that itself and the final tone-scale transfer curve is automatically 

correspond to the background and the collimator blades. constructed and adjusted for each input image. 

A good tone-scale curve should render the detailed struc- 5 6. Rirthermore, when information about examination type 

ture of the input image easily visible. Image regions that is available, this invention uses it to fine tune the tone-scale 

contain modulated signals should be allocated with sufficient parameters. When information about examination type is 

contrast and image regions that show little signal modulation missing, this invention will rely on the image signal alone 

can be rendered with low contrast. Signal modulations and can still provide a very good tone scale, 

represent image activities and should be measured as a 1° 

function of code values. DESCRIPTION OF THE DRAWINGS 

SUMMARY OF THE INVENTION FIG. 1 is a block diagram of an embodiment of the tone 

A j • - vi . . U1 scale adjustment method according to the present invention. 

According to the present invention , the problems set forth to r 

above of selecting the important code value sub-range and 15 mGS - 2 ( a H<*) show four different activity measures. 

constructing an optimal tone-scale curve is solved by mea- FIG. 3 is a block diagram showing a procedure far 

suring the image activity as a function of code value. In determining left-bound and right-bound points. 

general an activity histogram is computed from the input FIG. 4 is a block diagram showing how to determine 

image signals and the important code value sub-range is which orientation the image should be processed. 

identified by examining the shape of both the activity 20 mG 5is3L block diagram showing an "extract" routine. 

histogram and the code-value histogram. The tone-scale -™ , . . _ , A ^ A . . . . . 

. «. , , . , A . , . t FIG. 6 is a diagram of a finite state machine for ldenti- 

curve is then constructed based on the critical points . t . . - . t . 

. ^ . ^ . . j . . r~ ryine transition intervals m the profile of an image line, 

detected on the activity histogram and also on the charac- J 5 F 6 

teristics of human brightness perception. The resulting tone- PK*; 7 is a block diagram of a procedure for bounding box 

scale adjustment is such that important details of the body 25 <tetemiination. 

part are rendered equally visible throughout the entire lumi- FIG. 8 is a graphical view of code value vs spatial position 

nance range of the displayed image. Instead of the code- of a line of a digital radiographic image. 

value histogram, this invention computes a measure that is FIG. 9 is a block diagram of a procedure for deterrnining 

related to local image activity and uses the image activity far-left, left, right, and far-right points. 

histogram to extract the important code value sub-range 30 mG 10 is a 51ock of a procedure for finding the 

where signals are modulated. The code values that show a lot right ^ f ^git points from the rightmost peak. 

of image activity are given good contrast in the tone transfer . . . . . 

%n. iL u ^ i -J? - ^ - i FIG. 11 is a graphical view of the activity histogram and 

curve. Those that show little image activity are given low 4 , . ,t\ * * .\. & 

contrast budget or are compressed entirely. ** ****** of a P edia,nc chest ^ 

According to a feature of the present invention, there is 35 *». ^ * * diagrammatic view of how the major part of 
provided a method of automatic tone scale adjustment for optimized tone-scale curve is constructed. 

digital radiographic images comprising the steps of: FIG. 13 is a block diagram showing a procedure for 

providing an input digital radiographic image; constructing the complete tone scale curve, 

estimating the image noise as a function of code value of FKj. 14 is a graphical view of a tone scale curve con- 
said image; 40 strutted according to the present invention, 
deterraining the range of code values in said input image; FIG. 15 is block diagram of a procedure for reversing the 
deterrnining which way said input image should be pro- polarity of a tone scale curve to obtain a black-bone tone- 

cessed; scale curve, 

detennining a bounding box which contains the region of 45 FIG. 16 is a block diagram of a digital imaging system 
interest of said input image; incorporating the present invention. 

computing the image activity histogram of said input 

imay.; * DESCRIPTION OF THE EMBODIMENTS 

determining four points from said image activity histo- Although the method of the present invention is described 

50 with particular reference to digital radiographic image 

constructing the tone-scale curve for said input image; systems, it will be understood by those skilled in the art that 

and the method is also applicable to digital image systems in 

mapping said input image through said tone-scale curve to general. Referring to FIG. 16, there is shown in block 

produce an output image with good tone scale. diagram a digital radiographic imaging system incorporating 

The present invention has the following advantages. 55 the method of the present invention. As shown, the system 

1. The important code value sub-range is often more 10 includes a source 12 of digital radiographic images. The 
correctly identified because it relies on the image activity digital radiographic image includes a matrix of mxn pixels, 
rather the code-value histogram and ad hoc assumptions. where there are m pixels per line and n lines. Source 12 can 

2. The visual contrast and brightness of the output image be, for example, a storage phosphor reader which converts 
are rendered better according to the image activity 60 x-ray images stored in storage phosphors into digital radio- 
histogram, instead of the code-value histogram. graphic images; a film digitizer which digitizes a radio- 

3. The simplicity of the activity measure and its resulting graphic image on x-ray film; a magnetic or optical archive 
high speed of execution, storage system for storing digital radiographic images; a 

4. The method will work without any prior information diagnostic imaging modality (such as MRL CT. PET. US); 
about the body part being exarnined. 65 or a transmission channel. The digital radiographic image 

5. Because the tone scale curve is based on image activity from source 12 is stored in temporary storage 14. The 
and not a code-value histogram alone, it does not impose method of the present invention is carried out by image 
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processor 16. Image processor 16 can be a computer, an as a function of the code value because in computed 

image processing board, or other type of image processor radiography, the noise is dependent on the signal. There are 

well known to those skilled in the art Image processor stores two ways to estimate the noise variation: (a) The off-line 

the resultant tone scale curve in a tone scale look-up table method uses a gray scale of uniform patches at different 

(LUT) 18. The input digital radiographic image is mapped 5 exposure. The noise is calculated from the standard devia- 

through LOT 18 to produce an output digital radiographic ^on of the code-values in each uniformly exposed area. The 

image with the important code-value sub-range and with the noisc at any level of code vakie h men interpolated from the 

optimal tone scale for that sub-range. noise measurements of the neighboring exposures, (b) The 

Referring now to FIG. 1, there is shown a block diagram on-line method computes the edge gradient of every pixel to 

of the tone scale adjustment method according to the present 10 distinguish the uniform area from the busy area in an image, 

invention. The radiation image acquired from source 12 and m c noise value is estimated from the standard deviation 

(such as scanning a x-ray-exposed storage phosphor) is m the uniform area. Again, the noise at any level of code 

digitized into code values representing log-exposures times value is then interpolated from the noise estimated at the 

1000. 12 bits are used for the input digitized image. The first neighboring exposures. 

step (box 30) estimates the image noise as a function of code ^ jhe estimated image noise as a function of code value is' 
values. This noise function provides an uncertainty measure use 4 throughout the later processing. For example, if we 
for each code value. This uncertainty is called the noise waD t to check if the signal has reached a certain level, it is 
margin. The next step (box 32) determines the left-bound necessary to provide a margin of uncertainty due to noise. If 
and the right-bound of the input code values. The next step the noise standard deviation is 6 and the signal level we want 
(box 34) is to determine which way to process the image. 2 o to checkis 2000, then for code values between 1994=2000- 
Thc following step (box 36) determines a convex bounding 6 and 2006=2000+6, we can consider them as within one 
box which excludes part of the irrelevant foreground or noise standard deviation of the signal 2000. This uncertainty 
background. The next step (box 38) computes the activity margin due to noise is called the noise margin. In the 
histogram and the code- value histogram from the image area preferred embodiment, the noise margin, NOISE, is set at 
inside the bounding box. From these two histograms, the 25 2J5 times the noise standard deviation, corresponding to a 
next step (box 40) locates four points in the input code value confidence interval of 98.7% because the noise is distributed 
range. These four points are called the far-left, the left, the Nery "close to a Gaussian distribution, 
right, and the far-right point. The code varies between the (2) Detennining the left-bound and the right-bound points 
left point and the right point correspond to the important which define the range of code values in the input image: 
body part being examined. The far-left point and the far- 30 The code-value range of any single input image usually 
right point represent the end points of image activity. In the does not occupy the entire dynamic range of the image 
last step (box 42), these four points are used to construct the acquisition system. Before the tone scale adjustment process 
final visuaUy-optirmzed tone-scale curve for the input image begins to analyze the image data, some preprocessing steps 
to produce an output image, to exclude irrelevant data, such as those from the back- 
According to the present invention, the most relevant 35 ground and the foreground, are desirable for simplifying the 
code-value range (input code values) in a computed radio later processing steps and for reducing the probability of 
graphic image is determined by the image activities. Several errors. However, it should be pointed out that one of the 
types of image activity can be measured as a function of major advantages of this invention is that no perfect exclu- 
code values. Four of the image activity measures are shown sion of all irrelevant data is required in the preprocessing 
in FIGS. 2a-2d. The first three arc the Laplacian (FIG. 2(c)), 40 because the image activity measure used in this invention 
the edge gradient (FIG. 2(b)). and the code value can automatically select the relevant data later. The purpose 
co-occurrence (FIG. 2(c)). They have been widely used in of excluding the irrelevant data is to speed up the later 
digital image processing (as described in the book, "Digital processing and to reduce probability error. The goal of these 
Image Processing** by W. K. Pratt, Second Edition, John preprocessing steps are to detennine the minimum and the 
Wiley & Sons. New York. 1991, pages 503, 519, and 584). 45 maximum code values that cover the whole range of log 
The fourth image activity measure is the level-crossings exposures to be considered. They are called the left-bound 
(FIG. 2(<7)). Other measures of image activity (such as any and the right-bound points. Code values beyond these two 
local measure of signal variations. e.g., standard deviation, bounds are not considered farther, FIG. 3 shows the proce- 
mean or median of absolute deviation, or signal range in a dure involved in determining the left-bound and the right- 
local image region) can also be used, but will not be so bound. 

discussed further. According to a feature of the invention. The background image areas receive direct x-ray expo- 

the level-crossings are used as a measure of image activity. sure. They are irrelevant for tone scale adjustment and are 

The number of times a given input code value is crossed characterized (1) by the high code values and (2) by the lack 

along an image line, is accumulated for all lines inside the of significant modulation. These two features are used to 

bounding box in the image. These crossings for each input 55 detect background areas in the image. The code-value his- 

code- value level are called the level-crossings of the code togram of the background areas or the code-value histogram 

value. Since the number of level-crossing represents the of the entire input image is formed (box 50). The mincode 

activity of signal modulation around a code value, it can be (box 52) and the maxcode (box 54) are determined. The next 

used as a measure of the image activity at that code value. step (box 56) first attempts to find the background peak 

This invention discloses an efficient means for calculating 60 within an adaptive (or a predetermined) interval below the 

the level-crossing histogram and for using it to construct the maximum code value of the histogram that has a count 

tone-scale transfer curve. greater than 10 pixels. The right-bound is then placed at near 

The seven major steps of the tone-scale adjustment the valley below the background peak (box 58). If no 

method of this invention are described in detail as follows: background peak is found, the right-bound is placed at two 

(1) Estimating the image noise as a function of code values: 65 times the noise margin below the maximum code value. 

In order to distinguish the actual image activity from the The foreground image areas usually receive the least 
noise fluctuations, it is necessary to estimate the image noise x-ray exposure, but they are more difficult to locate, because 
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they arc much less uniform than the background and cover 
a much wider code locate range that usually overlaps 
substantially with that of the bone tissues. The foreground 
areas thus cannot be separated from the body part simply by 
code values alone. The method therefore uses the code-value 
histogram of the entire input image. The left-bound is two 
times noise margin added to the minimum code value of the 
histogram that has a count greater than 10 pixels (box 60). 
The noise margin as a function of code values is determined 
in step (1). 

If the difference between right-bound and left-bound is 
less than 030 in log exposure, there is sufficient dynamic 
contrast to print the image on the film and further analysis 
is not necessary. 

(3) Determine which orientation the image should be pro- 
cessed: 

Some of the image activity measures used in this inven- 
tion are calculated from the input image on a line by line 
basis. For certain image types, such as hands, feet, and arms, 
the orientation they are processed will affect the image 
activity measure. In general, the image line being processed 
should be perpendicular to the bone. FIG. 4 shows how to 
determine which orientation the image should be processed. 
In order to determine which way the image 5 should be 
processed the image was preprocessed in, two orientations, 
x.e.. horizontal (box 70) and vertical (box 72) (with one 
rotated 90 degree from the other) to see which orientation 
has shorter average line segments that are located between 
sharp transitions and show significant image activity. The 
orientation that has the shorter active line segments is 
selected for the later processing (box 74). 

This procedure uses a processing routine that extract the 
most modulated (busy) segment from a given image line. 
This "extract** routine is shown in FIG. 5. It performs the 
line segmentation by identifying transition intervals. It is 
observed that the transition between the body part and the 
background (or the foreground) is characterized by a large 
increase or decrease of the image code value. Within the 
transition, the signal change is so dramatic that the image 
profile (across any image line) shows monotonic rise or fall 
in code value, noise being too small to create fluctuation. 
The first step (box 80) is to set an adaptive threshold 
(CLIFF). The next step (box 82) in the preprocessing is to 
identify these transition intervals in the profile of an image 
line. This is accomplished by a finite state machine, shown 
in FIG. 6, where the input symbols "+'\ "-\ and 
represent that the code value of the current pixel is greater 
than, less than, or equal to the code value of the previous 
pixel A continuous sequence of pixels (an interval) showing 
monotonic trend of increasing or decreasing exposure is 
identified by this finite state machine. If the code value 
change within an interval is greater than a threshold. CLIFF, 
then the interval is classified as a transition interval (box 84). 
For each segment of pixels separated by the transition 
intervals, a linear function is fitted to it and the square error 
of the fit is used as the basic measure of busyness of the 
segment (box 86). The final busyness of a line segment is 
weighted according to its length and its code values. If the 
segment is too long or too short, its busyness is discounted. 
If the segment contains code values that are close to the 
right-bound or the left-bound points, its busyness is also 
discounted. After all these adjustments of busyness, the most 
busy segment in each line is used in the calculation of the 
bounding box (box 88). 

(4) Determining the bounding box: 

The next step is to determine the bounding box for the 
region of interest In certain examination types, such as 
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extremities and pediatrics, the body part under examination 
is often only a fraction of the total image area. Other areas 
on these types of image may have irrelevant objects that 
need not be considered for tone scale purpose. It is therefore 

5 beneficial to eliminate the irrelevant image areas from 
further consideration as early as possible, not only because 
it reduces the risk of false activity, but also because it saves 
computation time. This is accomplished by excluding the 
area outside of the bounding box from further data analysis. 

io A bounding box is a rectangular area that usually covers only 
25% to 65% of the input image area. 

FIG. 7 shows a block diagram of the procedure used for 
bounding box determination. The bounding box is calcu- 
lated by estimating the spatial extent and location of the 

15 active image areas. The estimation is performed by analyz- 
ing the image signal with a previously described routine 
(FIG. 5) that extracts the most busy segment from an image 
line, on a line-by-line basis (box 90). The bounding box is 
determined by finding the mean and standard deviation of 

20 the x and y coordinates of all the pixels of the selected busy 
segments from all the lines in the image (box 92). The 
bounding box is defined to be the mean plus and minus 1.5 
standard deviations (box 94). The size of the bounding box 
is constrained to be greater than a lower limit and smaller 

25 than an upper limit, as set by the users (box 96). If the 
examination type information is known, the algorithm is 
made to adjust the limits accordingly. For example, the 
bounding box of a chest image should not be smaller than 
60% of the input image in either dimension. On the other 

30 hand, some foot images can use a much smaller bounding 
box. For an abdomen image, it may be desirable not to have 
any bounding box at all. 
(5) Computing the activity histogram: 

(5.1) Level-crossing as a measure of image activity: 

35 The image activity as a function of code value is measured 
by counting the number of level-crossings at each code 
value for each image line. Let us take a line of a digital 
radiographic image, say a PA chest image, as shown in FIG. 
8, and look at the code value variation as a function of spatial 

40 position (an image profile), it is immediately clear that the 
code value is modulated up and down many times when the 
scan line goes across soft tissues and bones. Imagine that if 
we draw a line through a code value in the image profile in 
the transition between the soft tissues and the bones, that line 

45 will be crossed many times. Thus a simple measure of image 
activity at an input code value is to count the number of 
times it is crossed for all lines in the image. If the number 
of level-crossings is counted for each code value, we obtain 
a level-crossing histogram, which can be used as a measure 

50 of image activity as a function of code value. The level- 
crossing histogram is used as the activity histogram. In order 
to remove the transition crossings between the background 
and the body part for each image line, the level crossings are 
only counted for the section of the most busy segment 

55 inside the bounding box and only when the number of 
level-crossing is greater than a low threshold and less than 
a high threshold. The high threshold is imposed to avoid any 
potential problem that may be caused by external objects 
such as a pacemaker or tubes. However, simple counting of 

60 level-crossing will be very sensitive to noise, especially 
when the noise is highly dependent on the signal, as is the 
case in digital radiography. It is necessary to count the 
crossing only when the image exposure varies from signifi- 
cantly below (or above) the level in consideration to sig- 

65 nificantly above (or below) it, so that pure fluctuations due 
to noise will not be counted. This can be achieved by setting 
a lower and a upper threshold proportional to the noise 
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standard deviation at the code value being considered. In the pixels in the newest column. Therefore, for each new pixel 
preferred embodiment, the noise threshold is set at 25 times position, only 10 pixels have to be manipulated instead of 25 
the measured noise standard deviation, meaning that flue- pixels. 

tuation has to exceed 2.5 standard deviation of the noise (53) Edge gradient as a measure of image activity: 
before the level-crossing will be counted. 5 The image activity as a function of code value is measured 

Level-crossings counting can be implemented efficiently. by computing the average edge gradient at each code value. 
The counting process keeps four variables and two arrays. FIG. 2(b) shows an example kernel used to compute the 
Two variables, u lowl" and "highl", keep track of the lower horizontal and the vertical component of the edge gradient 
level and the upper level for the previous pixeL The other of the center pixeL The magnitude of the edge gradient is the 
two variables. "low2 M and "highS". are for the current pixeL 10 square root of the sum of the squares of the horizontal and 
These levels are set by adding and subtracting noise margin the vertical components. The edge gradient is computed for 
to and from the code value under consideration. The image all pixels of the most busy segments inside the bounding box 
signal has to cross from below the lower level to above the and the magnitudes of edge gradients of all the pixels with 
upper level (or the other way) to be counted for one crossing. the same code value are acciimulated. The accumulated edge 
One array, "sign", with one entry for each input code value, 15 gradient magnitude as a function of code value is used as the 
stores the status of each code value relative to the previous activity histogram. Alternatively, the accumulated edge gra- 
pixel value. For example, if the previous pixel value is 1528, dients can be divided by the square root (or other function) 
and the noise margin for 1528 is 24, men low 1=1504 and of the number of pixels contributing to each bin in the 
highl=1552. All entries in the array "sign" with indices histogram. 

higher than 1552 have a value +1, meaning that they are 20 (5.4) Laplacian contrast as a measure of image activity: 
above, the previous pixel value, and all entries with indices The image activity as a function of code value is measured 
smaller than 1504 have, a value -1, meaning that they are by computing the average Laplacian contrast at each code 
below the previous pixel value. All entries in this "sign** value. FIG. 2(a) shows an example of the kernels used to 
array are initialized to zero in the beginning of each image compute the Laplacian contrast of the center pixeL The 
line. The other array, "change", keeps track of how many 25 Laplacian contrast is computed for all pixels of the most 
times the sign of each code value has changed as each pixel busy segments inside the bounding box and the absolute 
of the current image line is processed. Continuing with the values of the Laplacian contrast of all the pixels with the 
example, let the current pixel value be 1536 and its noise same code value are accumulated. The accumulated Lapla- 
margin be 22. Then, low2= 153 6— 22=1514 andhigJo2^1536+- dan contrast magnitude as a function of code value is used 
22=1558. As we move from the previous pixel to the current 30 as the activity histogram. Alternatively, the accumulated 
pixeL the array "sign" has to be updated, and so does the Laplacian contrast can be divided by the square root (or 
array "change". If highl is greater than high2, we update the other function) of the number of pixels contributing to each 
signs in the range of (high2, highl). If low2 is greater than bin in the histogram. 

lowL then we update the signs in the range of (lowL low2). None of the above activity measures explicitly includes 
In the above example, the signs in the range of (1504, 15 14) 35 the size of an image area as a factor in rendering the input 
are updated to -1. If the previous sign at a code value, say image. The code-value histogram, on the other hand, is 
15 10, was +1, men we have detected a change of sign, Le., much mare directly related to the area size information. For 
a level-crossing at 1510 and the corresponding entry in the some examination types, a weighted average of the various 
"change" array , is incremented by 1. Since the code value activity histograms and the code-value histogram may pro- 
change is usually small from pixel to pixel, the number of 40 vide a more robust measure of image activity. Preferably, the 
updates in the arrays "sign" and "change" is small too. The average of the level-crossing histogram and the code- value 
entire counting process thus can be finished in a short time. histogram, computed from all pixels of the most busy 

(5.2) Code value co-occurrence as a measure of image segments inside the bounding box, is used as the image 
activity: activity histogram. Since the code-value histogram contains 

The image activity as a function of code value is measured 43 the size information and the level-crossing histogram con- 
by counting the number of times different code values occur tains the activity informatioEL using their average allows us 
in an immediate neighborhood in the input image. If there is to balance the visual impact of both types of information, 
no signal modulation in an image area, the code values in the (6) Determining the far-left, the left, the right, and the 
immediate neighborhood of a pixel will fluctuate due to far-right points: 

noise. When there is signal modulation, the neighboring 50 FIG. 9 shows a block diagram of how this step is 
code values will change with a magnitude much larger than accomplished. The highest peak of the image activity his- 
expected from pure noise alone. In this preferred togram is first located (box 100), and its height is used to 
embodiment, let the code value of the central pixel in a 5 normalize the histogram so that the highest peak is 1.0 (box 
pixel by 5 pixel window be CO and that of the other 24 pixels 102). Similarly, the code-value histogram is also normalized 

be CI, C2 C24. Any of the 24 neighboring code values 55 to its peak. The algorithm then finds the leftmost peak and 

which differs from CO by more than a noise threshold can be the rightmost peak, higher than 03 and within about 1.0 log 
considered as having some signal modulation, Le., image exposure from the highest peak of the image activity histo- 
activity. The number of neighboring pixels exceeding the gram (boxes 104, 108). Once the rightmost peak and the 
noise threshold therefore represents the image activity at leftmost peak are located, the algorithm proceeds to deter- 
code value CO. This counting process is performed over all 60 mine the right point and the far-right point from the right- 
the pixels of the most busy segments inside the bounding most peak, and the left point and the far-left point from the 
box and the counts are accumulated for each code value to leftmost peak (boxes 106. 110). 

form an activity histogram. An efficient counting process is FIG. 10 shows how the right point and the far-right point 
to keep track of the code-value histogram of the 5 pixel by are found. The parameters rl and r2 are used to restrict the 
5 pixel window and update the histogram when the window 65 range of the search. The thresholds, al, a2, tL t2, and s are 
is moved to the next pixeL The updating is performed by predetermined values. Similar procedure is used to find the 
deleting the 5 pixels in the oldest column and adding the 5 left point and the far-left point From the rightmost peak 
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(box 120). the method searches down the right of the The tone-scale curves used by most computed radiogra- 

rightmost peak until the image activity becomes too small or phy systems have been designed to provide similar "looks" 

the height or slope of the code- value histogram becomes too as those of some film sensitomctric curves. In this invention, 

small, or the code value becomes too far from the peak a completely new family of curves is used to optimize the 

(boxes 122, 124, 126). The far-right point is located (box 5 v i SU£ Q discrimination of fine objects. This family of curves 

128) simply by searching down the peak until the image is based on me human brightness perception model under 

activity is less than a very low threshold. Siirnlariy^the left typical x-ray image viewing conditions. The tone-scale 

EC *? S ^ t0 curve is designed torender equal log-exposure differences in 

Fia if shows the activity histogram and the code-value ^fSr" ^ blightneSS * 
histogram of a pediatric chest image. In this case, the two *JL7 image. . , . 
histo^ams are similar to each othe? (although this may not u * U an a™?? f h ™ ^ ^ ^(other 
be true in general). The far-left point, the left point, the right toe and 1116 * visually optimized 
point and the far-right point found by the algorithm for this tone-scale curve is constructed. In this procedure, the map- 
image are marked by vertical lines. P in S s brightness to luminance, and from luminance to 

The heuristic argument behind the determination of the 15 ft 011 density are image-independent models. The only 

left-point and the right-point is based on the idea that if the image-dependent step in this procedure is the straight line 

image activity or the number of pixels becomes too small. mapping between the log exposure and the brightness. The 

there is not much information to be rendered. If the left point slope and offset of this straight line are two parameters that 

and the right point are correctly determined, then all the are automatically adjusted from image to image. The tone 

pixels with code values between them will belong to the 20 scale curve generated from this step has very sharp cut-offs 

body part If the pixels that have code values between the left at both ends of the curve where the minimum density and the 

point and the right point are set to 1 and all other pixels set maximum density of the output media are reached. These 

to 0. then we will have a binary image where ideally all will produce a hard-clipping in the displayed image. It is 

pixels outside of the body part has been set to 0. The body therefore necessary to roll off both ends (the toe and the 

part region should appear as a connected image region 25 shoulder) of the curve. 

without any holes in them. If the left point and/or the right FIG. 13 shows the procedure for constructing the corn- 
point are not determined correctly, then there may be holes plete tone scale curve from the far-left, the left the right and 
in the region. The code values in these holes are then used the far-right points. First the linear brightness vs. Log E 
to extend the left point and the right point to the lower and curve is determined by mapping two log exposure values to 
higher code values. This heuristic makes sense only if the 30 two pre-selected density values (box 130). Next brightness 
initial estimates of the left point and the right point are close is mapped to luminance (box 132). Then, luminance is 
to the true values and if the background, the foreground, and mapped to film density (box 134). Combing all these three 
other irrelevant objects have code values that are not over- mappings, the visually optimized tone scale curve is con- 
lapping with that of the body part to be examined. Both structed (box 136). Then we need to determine two more log 
assumptions fail for some images and additional precautions 35 exposure values to be mapped to the two other densities 
should be taken when extending the left point and the right where the toe and the shoulder are to be rolled off. These two 
point to fill the holes in the "body part". First, only those more log exposures are two additional parameters needed to 
holes that are completely surrounded by the body part are generate the final tone-scale curve. The toe and the shoulder 
reliable candidates. Second, the holes should not contain of the curve are generated by an analytical equation and then 
many values that are close to the (foreground) or the 40 pasted to the visually optimized curve generated according 
maximum (background) code values. If the examination to FIG. 12 (box 138). The tone-scale curve thus has four 
type information is available, then this hole-filling process degrees of freedom that could be determined by the far-left 
can be turned on or off depending on the body part being point the left point the right point and the far-right point 
exarnined. For example, it is always good to check holes for The left point and the right point are used to determine the 
chest images, but may not be too useful to do so for C-spine 45 slope and intercept of the linear mapping between the log 
images, because the later often contain an overlapping exposure of the radiation image and the brightness of the 
code-value range between the bone and the foreground. printed or displayed image. For example, for a chest image, 

Checking holes in the identified boy part is further fol- the right point is mapped to an output film density of 2.1 , the 

lowed by a general quality control procedure that checks the left point is mapped to a density 0.5 above the minimum 

general geometrical shape or the spatial distribution of the 50 density of the film, and the distance between the left point 

image region(s) formed, by the pixels whose code values are and the right point is used to determine the contrast of the 

between the left point and the right point. For example, if the tone-scale curve. The construction of the tone-scale curves 

resulting region covers the entire image, except a sizable can be made to depend on the body part being exarnined if 

rectangular hole in the middle of the image, then it is very that information is available. For example, in order to make 

likely that the left point and the right point have been 55 skin lines easily visible, the right point can be shifted to a 

incorrectly identified and the algorithm should go back to lower density, say 1.6. far hand, foot, and ankle images. The 

see if other alternative activity peaks should be searched. far-left point is used to determine where the toe of the 

(7) Construction of the Tone Scale Curve: tone-scale curve should begin to roll off, and the far-right 

The code-value range between the left point and the right point is used to Determine where the shoulder of the tone- 
point covers all the pixels that show most significant image 60 scale curve should begin to roll off. FIG. 14 shows an 
activity and therefore should be rendered with good image example of a tone-scale curve constructed according to this 
contrast The code-value range between the far-left point and invention. 

the left point covers the pixels that show lower level of For some appUcations, sometimes it is desirable to display 

activity, and similarly does the range between the far-right the image in reverse tone polarity (called the blackbone tone 

point and the right point. The code values outside the far-left 65 scale because in normal x-ray image viewing, the bones 

and the far-right points contain very little image activity and, usually appear white. Reversing the tone polarity makes the 

therefore, can be rendered essentially as flat fields. bone appear black.) to see a certain part of the body better. 
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la die current invention, this is accomplished by reversing in the histogram that has more than 10 pixels, finding the 

the roles of the left point with the right point, and the far-left background peak within an adaptive interval below 

point with the far-right point For example, if the input code maxcode, if the background peak is found determining the 

value range is from, 0 to 4095, then using 4095— far-left as first valley to the left of the peak as the right-bound, if the 

the new far-right point, 4095 — left as the new right point, 5 peak is not found, then setting right-bound^maxcode-2* 

4095— right as the new left point, and 4095-^ar-right as the NOISE, setting the left-bound==mincode+2*NOISE. 

new far-left point, will produce a new tone scale curve 7. The method of claim 1 wherein said step of detenriining 

(boxes 140, 142). Reversing the polarity of the resulted which way said input image should be processed includes 

tone-scale curve, by using 4095 — code value, will give us the steps of: extracting the most modulated segments from 

the desired blackbone tone-scale curve (box 144). FIG. 15 10 all image lines in the horizontal direction and calculate the 

shows the procedure of accomplishing this, where CM AX average length, extract the most modulated segments from 

refers to the maximum code value, Le„ 4095 for a 12-bit all image lines in the vertical direction and calculate the 

system. average length, and if the average length of the horizontal 

In the apparatus that embodies this invention, the tone- segments is shorter than that of the vertical segments, then 

scale curve is implemented as a lookup table with as many is the image activity will be calculated with the horizontal 

entries as the number of the code values. Every pixel in the segments, or else, vertical. 

input image is mapped through this lookup table to produce 8. The method of claim 7 wherein said extracting steps 

the tone-scale adjusted output image to be printed or dis- include the steps of: setting an adaptive threshold, CUFF; 

played on the output media. partitioning an image line into intervals by a finite state 

The invention has been disclosed in detail with respect to 20 machine; if, within an interval, the code value changes by an 

preferred embodiments thereof, but it will be understood amount greater than CUFF, then labeling the interval as a 

that variations and modifications can be effected within the transition interval, and grouping other pixels on the image 

spirit and scope of the invention. line into segments separated by the transition intervals and 

What is claimed is: the image boundaries; fitting each segment with a linear 

1. A method of automatic tone scale adjustment for digital 25 function and using the residual error of the fit as a measure 
radiographic images comprising the steps of: of signal modulation of that segment; and extracting the 

providing an input digital radiographic image; segment with the largest signal modulation, 

estimating the image noise as a function of code value of 9 - ™ e of daim 1 said step of detenmning 

said image- tne b 011110 ^? °°x includes the steps of: extracting the most 

. ^ . . ' j. * i . • ■ * . • 30 modulated segments from all image lines; detenuinine the 

determining the range of code values in said input image; ir * . ^ ' A ° 

... , , , , spatial spread of all the pixels in the extracted image 

determmng which way said input image should be pro- ^ mean and ^ ^ x . ^ 

cessea; the y- directions; detenmning the width and height of the 

taermining a bounding box which contains the region of rcctangular bounding box. wherein width is 3 standard 

interest of said input image; 35 deviate - m ^ ^-direction and height is 3 standard devia- 

computing the image activity histogram of said input tions m ^ y-direction; and centering the bounding box at 

ima S e ** the x-mean and the y-mean, with the width and height being 

detenmning four points from said image activity histo- adjusted so that they are within preselected ranges and also 

gram; we u within the image boundary, 

constructing the tone-scale curve for said input image; 40 10. The method of claim 1 wherein said step of computing 

and the image activity histogram includes the steps of: process- 
mapping said input image through said tone-scale curve to ing the digital image on a line by line basis; calculating 

produce an output image with good tone scale. image activity at each pixel for each image line; and 

2. The method of claim 1 wherein said providing step accumulating the image activity for each code value from 
includes converting an x-ray image stored in a storage 45 each image line to form a cumulative activity histogram as 
phosphor into said input digital radiographic image. a function of code value, 

3. The method of claim 1 wherein said providing step 11. The method of claim 1 wherein said step of computing 
includes digitizing a radiographic image on x-ray film to includes the step of measuring image activity by calculating 
produce said input digital radiographic image. the Laplacian contrast for each pixel. 

4. The method of claim 1 wherein said estimating step 50 12. The method of claim 1 wherein said step of computing 
includes the steps of exposing a gray scale of uniform includes the step of measuring image activity by calculating 
patches at different exposures, calculating noise from the the edge gradient of each pixeL 

standard deviation of the code values in each uniformly 13, The method of claim 1 wherein said step of computing 

exposed area, and interpolating the noise measurements of includes the step of measuring image activity by calculating 

neighboring exposures. 55 the code-value co-occurrence histogram. 

5. The method of claim 1 wherein said estimating step 14. The method of claim 1 wherein said step of computing 
includes the steps of computing the edge gradient of every includes the steps of measuring image activity by counting 
pixel of the input image to distinguish the uniform area from the level-crossings for each code value by, for each image 
the busy area in said image, estimating the noise value from line, updating an array that keeps track of the number of sign 
the standard deviation in the uniform area, and interpolating 60 changes for each code value, and accumulating the number 
the noise at any level of code value from the noise mea- of sign changes from each image line to form a cumulative 
surement of neighboring exposures. histogram of level-crossings as a function of code value. 

6. The method of claim 1 wherein said step of determining 15. The method of claim 1 wherein said step of deter- 
the range of code values in said input image includes the mining the four points includes the steps of: within the range 
steps of: calculating the code-value histogram, setting 63 between left-bound and right-bound, finding the highest 
mincode=the smallest code value in the histogram that has peak, p. in the activity histogram; normalizing the amplitude 
more than 10 pixels, setting maxcode=thc largest code value of the highest peak to 1.0; locating the rightmost peak within 



07/16/2004, EAST Version: 1.4.1 



5,6: 

15 

1.0 log exposure above p and with normalized amplitude 
higher than 0.3; finding the right point (rp) and the far right 
point (ftp); locating the leftmost peak within 1.0 log expo- 
sure below p and with normalized amplitude higher than 03; 
and finding the left point and the far-left point (flp). 

16. The method of claim 1 wherein said step of construct- 
ing the tone scale curve includes the steps of; determining 
the brightness vs. Log E curve from the formula Brightness^ 
a*logE-*b by determining the slope a and the intercept b 
from the left point lp and the right point rp by mapping lp 
and rp to preselected densities; mapping brightness to lumi- 
nance using the perceptual brightness model 

LuminaiIce=c [ i-^ ] ; 

mapping luminance to film density, where D=log Source- 
log Luminance; constructing the visually optimized tone 
scale curve, D=f(log E). that renders equal log exposure 
differences as equal brightness differences; and generating 
the toe and shoulder tails with the following equation 
rMDrnax-DnuB)/(l+[E/EO]^>+-Dmin. 

17. The method of claim 1 wherein, in said detenrdning 
four points step, left and right feature points are determined 
and including the step of producing a reversed-polarity tone 
scale by exchanging roles of said left and right feature points 
for a normal tone-scale algorithm and then reversing the 
polarity of the input code values. 

18. A method of extracting the important range of code 
values from an input digital image by computing image 
activity as a function of code value, comprising the steps of: 

(a) processing the digital image on a line by line basis; 

(b) calculating image activity at each pixel for each image 
line; 

(c) accumulating the image activity for each code value 
from each image line to form a cumulative activity 
histogram as a function of code value; and 

(d) locating the highest peak(s) of the activity histogram 
and one point on each side (the left and the right) of the 
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peak(s) wherein the histogram height falls below cer- 
tain thresholds; and 
(e) extracting the range of code values between the left 
point and the right point, as identified in the previous 
5 step. 

19. The method of extracting the important range of code 
values from an input digital image claimed in claim 18, 
wherein the image activity is measured by calculating the 

lQ Laplacian contrast for each pixel 

20. The method of extracting the important range of code 
values from an input digital image claimed in claim 18, 
wherein the image activity is measured by calculating the 
edge gradient for each pixel. 

is 21. The method of extracting the important range of code 
values from an input digital image claimed in claim 18, 
wherein the image activity is measured by calculating the 
code-value co-occurrence histogram. 
22. A method of extracting the important range of code 

20 values from an input digital image by counting the number 
of level-crossings for each code value, comprising the steps 
of: 

(a) processing the digital image on a line by line basis; 

(b) for each image line, updating an array that keeps track 
25 of the number of sign changes for each code value; 

(c) accumulating the number of sign changes for each 
code value from each image line to form a cumulative 
histogram of level-crossings as a function of code 
value; and 

30 

(d) locating the highest peak of the level-crossing histo- 
gram and one point on each side (the ieft and the right) 
of the peak where the histogram height falls below 
certain criteria; and 

35 (e) extracting the range of code values between the left 
point and the right point as identified in the previous 
step. 

***** 
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